%0 Conference Proceedings
%4 sid.inpe.br/sibgrapi/2021/09.06.22.26
%2 sid.inpe.br/sibgrapi/2021/09.06.22.26.16
%@doi 10.1109/SIBGRAPI54419.2021.00018
%T Fast Spatial-Temporal Transformer Network
%D 2021
%A Escher, Rafael Molossi,
%A Drews-Jr, Paulo,
%A Bem, Rodrigo Andrade de,
%@affiliation Federal University of Rio Grande
%@affiliation Federal University of Rio Grande
%@affiliation Federal University of Rio Grande
%E Paiva, Afonso ,
%E Menotti, David ,
%E Baranoski, Gladimir V. G. ,
%E Proença, Hugo Pedro ,
%E Junior, Antonio Lopes Apolinario ,
%E Papa, João Paulo ,
%E Pagliosa, Paulo ,
%E dos Santos, Thiago Oliveira ,
%E e Sá, Asla Medeiros ,
%E da Silveira, Thiago Lopes Trugillo ,
%E Brazil, Emilio Vital ,
%E Ponti, Moacir A. ,
%E Fernandes, Leandro A. F. ,
%E Avila, Sandra,
%B Conference on Graphics, Patterns and Images, 34 (SIBGRAPI)
%C Gramado, RS, Brazil (virtual)
%8 18-22 Oct. 2021
%I IEEE Computer Society
%J Los Alamitos
%S Proceedings
%K Deep Learning, Video Inpainting, Reformer Networks, Transformer Networks.
%X In computer vision, the restoration of missing regions in an image can be tackled with image inpainting techniques. Neural networks that perform inpainting in videos require the extraction of information from neighboring frames to obtain a temporally coherent result. The state-of-the-art methods for video inpainting are mainly based on Transformer Networks, which rely on attention mechanisms to handle temporal input data. However, such networks are highly costly, requiring considerable computational power for training and testing, which hinders its use on modest computing platforms. In this context, our goal is to reduce the computational complexity of state-ofthe-art video inpainting methods, improving performance and facilitating its use in low-end GPUs. Therefore, we introduce the Fast Spatio-Temporal Transformer Network (FastSTTN), an extension of the Spatio-Temporal Transformer Network (STTN) in which the adoption of Reversible Layers reduces memory usage up to 7 times and execution time by approximately 2.2 times, while maintaining state-of-the-art video inpainting accuracy.
%@language en
%3 FastSTTN___SIBGRAPI_2021.pdf